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;57)Abstract: 

PROBLEM TO BE SOLVED: To provide a projector that projects an image onto an optionally 
three-dimensionally shaped projecting screen and can obtain an output video image without 
distortion. 

SOLUTION: A camera photographs a point Q on a projection screen corresponding to a 
measurement point P in a video image outputted from the projector and a point R corresponding 
to the point Q is detected from an obtained camera image. Then using a camera internal 
parameter denoting an internal characteristic of the camera calculated in advance calculates a 
camera coordinate at a point R" in a space corresponding to the point in the camera image. Then 
utilizing an expression of the projection screen calculated in advance or a set of points calculates 
the camera coordinate of a cross point Q between the projection screen and a straight line tying 
the lens center Oc of the camera and the point R". Finally cross-references between the point of 
the camera image and the camera coordinate of the cross point Q are obtained while changing the 
position of the point P, and the position attitude in the camera coordinate system of the projector 
and the projector parameter denoting the internal characteristic are calculated. 
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[0086] Ztlt><?>mrf3Z£Z>t. (DiO 

[0087] 

[&25] 



CCD^<0SPid CI , v ic :fif|tn<OCCDaH^Ol§!Pid 
„. u ic ^T[6]C7)CCDS^i!cN CCI , lSStOtyT' 

^HRN cfl ) «»iii»aj^S8 3t:J:or, ^ 



Y 



















(2 7) 



[0088] Wf8.K>±mX\ 

[0089] 

[^C26] 
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[0090] b-ftlti , m#Jss^-c<o^®^«z 



'cl 


''c2 






7" 

■* cx 


''c4 


'•'c5 






7" 


''c7 


'" c8 






7" 



c9 



z.-T 



[0091] WJb#. tiX?ftt&*7*-?W.lil^&4 

[0092] ore zn^mtf^t o^mosaac 

oivt. 09Sr#ffgt^*^PW'^-r«.. 
[0093] t-T . A7>lft«#g4 J: OB*®** 

wrftfti. £>*il>. Z\ZX'liftBlz&tf 1 o£>& totco 
vvt^l&Hj§-f.£ )<> Srfc. I^rny'i^^IM 
gUfcfcfcWCP (u fp , v fp ) h^-rith-Ti.. 
>-W»£j£*&4T'«^ f^n7Dy'x?^A-5X- 

t -eixmop ( u fp , Vf p ) <D{mt>m%h x 0 tzrt 

fci^T (x c , y e , z c ) i:«-ft,<7)t^. 
[0094] 0#'e B*tUii7W&6(;: J: 0B*«Ofit^ 
#^;bftTO&£f£®£;M7 7#J«iJU #*5B(1 

K^g8ietoT. fWi^M^f&OB^iltf&i: 

mmmm&x'<m.mz (u fc , Vfc )fcts. 
[0095] it«!i^ra{aamai*S8 4tn ^7 

ttjftO**t«HL4*»fe, R (u fc . v fc ) *>£>Q 
( x c , y c , z c ) £it^~-S.. 
STEP 1 

(7) (8)K, R(u ft , v fc )HR' (x dc , 

y dc ) fc«T«Sfcj: ossw-*. 

X dc S CI ' ^ c 
y<lc=dcy (V fc " 

STEP2 

(4) P " (x dp , y dp ) R" (x dc . y dc ) £ 

P" (x up , y up )R" (x uc , y uc ) {.Z^^fh. 
STEP 3 

;M ^H^JSjSO c ^S^T'OftS ( 0 , 
0 , 0 ) t R" ( x uc , y uc ) cr>jj* ^mmkX'CD&U 



(u fc -u cc ) (29) 
v cc ) (30) 



cz = 0 (28) 



(x uc , y uc , f c ) IMOcR" ±C9.£Q 

(x c , y c> z c ) a. mir^m.t^m^x 

[0096] 
[^2 7] 

- v c r/c * 

•yc=y U c-t (3D 

[009 7] tmZtlZ. iSWBf* J *S5«f (x, y, 
z) =0CJ;i9*^n-Si:-m{f. 
f (x c> y c , z c ) =0 (32) 
tfSWOOT. (3 1) (3 2)K« t )±')f 
(t) = 0*»wc, ^ftfcioTft^fi/StSrti 
(3 1 ) tCk-oT (x c , y c , z c ) ££#>il{±*J; 

iiff. S»iB<o*i&« (2 8) cox o izmzti&m 

[0098] 
[£*28] 



I = 



'"'c7 -""uc + '''en Ac + r c9 Jc 



[00 99] ttchCDX 
[0 100] 
[&29] 

T 



CZ *ltC 



r' 


c7 




+ '•'cx y uc 


+ ^'c9 


/c 








T v 






r 


cl 




+ '"'eg Ac 


+ >*'c9 


/c 








V f 

1 cz J c 






r' 


c7 




+ ^'c8 Ac 


+ >" c9 


/c 



(3 3) 



Uc = 



z c - 



[0101] ifc, f5^H* J ^m^-U = 

{ (x ck , y C k, z ck ) I kli£i£ffi£«j£-r&£cO<! 
ISO (31) <0t £^fc£-ti:&#£>, 

(x e , y c , z c ) eu*i»fc-f£3*rfc<0£flHi:lfJ: 

[0102] JJU^WSftSSIBHaB»aj#S8 4C0»^ 

x-bh. 

[oio3] ore fHa^flBfeit¥g8 5-C'fi. J* 

9 vmmz&^fQLAX'm&hWzhw vmmz&tf 

6P (u fp , v fp ) coztit'tilz&^x . mifB (u fp , 
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v fp ) t (x c . y c , z c ) CO^tmm^t^. 

[0104] &mz. roy ? ^-^atft^g 

S( (1)-(13), ( 1 4 ) - ( 2 6 ) ) T'^«T 

^^a5rfiJffl-r?»;i:* i -C'^.S.. dtii, Tsai^f 
^ 'J /P-y 3 v& <##;£iiR«iByi£) ^fflv^^C 

[0105] ClCO^i. Nfli ( N : ^&) 

mmixci. y c ±. z ci ) (i^t'{±ia^s=^^7 
j^g) tznmznm-f &7ms*7?wmim (u 
f pi , v f pi ) nmmM&Mjmw&m i *=«t * 

fi^iJRp (*fcl»3ffl) i:&jt<?h/UT P (*»SC3 
k pl> k p2 . X^-/H&&s pi . rox'i^^IMI 



v cp ) 



*5U S*ffiWfi=Xr>9ffi««i:=5rSfc 
o^'x 9 9 'OKK^XKf- htetfXD&M^? h/UT c p 

tmiztttz. jar. s pl &Bt» (a«i. o)h 

STE P 1 

7Dy'x??<^t«A^N p „, N pfI . d' PI> d py £ 
STE P 2 

/nyi^^Ii^^Ii+'D (u cp , v cp ) ft 

h. 

STE P 3 

N*<0 (x dpi , y dpi ) 



>-dpi 



= S, 



d " P1 ( u fpi -u cp ) ( 34 ) 



ydpi = dpy < v fpi- v cp) (35) 



I py 



STEP4 



( x c 



-l 



y C i. 

T„ 



z ci ) t (x d 



■ i 



"p4 ' 



'■dpi' J" d pi 

py x pl» 1 py ~ 1 p 2 • 1 py **px ' ^py ' ^"p* ' 

[0 106] 
[St30] 



yapi x cs 


T 


1 p> 










pv 






ydp, 




P>* 
















~~ * dp i Yd 




.V 







(36) 



1^2. (16) 
x =0 (37) 



[0 107] 
STEP 5 



(17>K 



• i 



py 1 pi' 1 py i p2> 1 py r px ' 



P 4 . 



[0 108] 
[»3 1] 



c = 



(38) 



[0 109] 
[»32] 



r. 



pi py pi 



py py p 5 



r, 



-j 



(39) 



[oiio] tt&. ft?nc0ffi*Mim<nw*&o"e 

[0111] 
[S3 3] 



S r -^S r ' -4{r' ir ' 5 -rUr' 2 ) 



(4 0) 



[0 112] Jt*fU s r =r " , 2 +r " ^ 

+ r ' 4 2 + r V 4?5(C<W*fcli?!l3&« 
0?)i§-&{2u 

[0 113] 

[gc34] 



[0 114] fcfc'U r 



STEP 6 

H&*'1> ( u cp . v cp ) frb-HH&vfcA ( u fpi , v 

, Pi ) b*e>ttmt&&<?wft-Bgm (x ei , y ci , 

z ci ) 3&»i5»T p ,<^Br9*efcJ&f-4. T py ^«F-^S- 
lEtLX. 
[0115] 
[&3 5] 



(til) 101-320652 (P200 1-320652A) 



r p s 



py r p\)*py> 
— py t'p 5 YTpy • 



^2 
7 



-1 



~ (7 py r p4^ py 



py* f p4 



P* 



~~^py ^ pxT^ py 



* = r pi x ci + r p2 y ci + T px 

y = r p **ci + fpsy c i +T Py (4 2) 
[0 1 16] Sr^tf), xtU<7)^'fL<A'Oyi:V 

STEP7 



pi 



P2 • 



p4 • 



p5 



[0 117] 
[R36] 



r p4 



r p2 



f >5 



pl 



r p7 r pZ 



P* 
r p9 



-r, 



pi 



(4 3) 



[01 18] fvTfc'L, s=- s g n ( r pl r p4 + r p2 r 
p5 ) r p7 , r p8 , r p9> HR p tm^fffiX'h 

ht^?&mzvimLX3<#>&. sTEPstf 



[0 119] 
[R37] 



r p i 


r p2 




r ps 


■r p7 





~ ^- r p\ ~ r p2 2 

-s^jl-r p4 2 -r p s 



r p9 



(4 4) 



[0 12 0] SrJHWS,. 
STEP8 

UyXWfrZHmL. (k pl = k p2 = 0) fcLT. f p 

£jhwc f p t pz t-thmm^m^^ m< . 

[0121] 
[&38] 



= w 



<.</,,,£/, (4 5) 



[0 12 2] fcfc'U 

y j — *" p 4 x ci^" r p5 ^ ci ^~T py 

wi= r p7 x ci + r p8 y ci (46) 
STE P 9 

S T E P 8 X-$!tbtl f P k T p x U J; V k p , = k p 2 = 0 £ 
Mli: LT. (25) £-#89B£j&ftl8]jSi: LTfl? 
l> fp, T PI> k pl , k p2 £;&y>.g>. 
[0123] IJLh^'T s a i U TV— a 

[0124] mmzztL^com^MtaLtim. zomzk 
Sr«fttteii#s 9 use**-* . 

[0125] JJLhjft**^ U ?V-:x 3 >-#g8<7)Mai*l 
[0126] ol'C, «SE«¥«9(cie«3*iJfcfll* 



TSMBLfclMHTl 1 -2 3 6 1 8 7#i:RSL Toy 

is*. 9 fmmzttLxmmw^ifaffrtfai.zm^x^ 

hfr*7fc?ft&. (TD^'x^^^ao^ttSr^Sitffi 

f*ko. ^tt^a^-t^wcoiHio^iBiicft) 

(Toyx 7 ^SMO^I: 11X^4 *¥M<0ig "JOB 

£ ix h 3 ^ - * *f&mzi£#>h z fc & . 

L^ot. ££T«±, «WHi*»j^-ft*jS[^)rn^ 

[0127] t-T. >**>««£jjc#«4U:, 
hVV^^&£TOj/'x?:?H&£#f£U B*fliai7J 

#S6 t i -yxmmttm-fh . mm 



(& 2) 101-320652 (P200 1-320652A) 



to 1 28] *^7ii. ro-/'i7^m©& 
a. wt, **j6-?t*4>*ifcH**p (u fp , Vfp ) , r 

( u fc . V fc ) ftZ). 

C 0 1 2 9 ) o?t, P fc Rtf5««*»<5> . ttttEtt^S 

?**«*T0>fiMi (x p , y p , z,) £fiTF«>£3fc: 
LTiftJ&*-&. STEP1 (7) (8) (20) (2 
1 ) P (u fp , v fp K R (u fc , v fc ) Sr^ft 

•?ilP " (x dp> y dp ),R~ (x dc> y dc )mT^) 

x dp = s pi d ' p , ( u fp -u cp ) (47) 



Ip =d py ( v fp 



v cp ) (48) 



•i d 



(u fc -u cc ) (49) 



x dq S CI 

y dc -d cy ( v fc -v cc ) (50) 
STEP2 

(4) ( 1 7) J:*?. P * (x dp , y dp ) R 
y dc ) 5rP" (x up , y up ) R" (x uc , y uc ) {Z^ 

STEP3 



(x 



dc • 



( X p 



z po ) fcR" (x uc , y uc ) coyuitjL 



991&lW&C<W5iM fx pr , y pr , z pr )£(27)J: 

[0 130] 
[i!c39] 



y po 
\ z p°j 



A ^cp x cp 



(5 1) 



[0131] 
[8(4 0] 



pr 


- 


fx > 




y pr 






\ Z prJ 









'cp 



(52) 



[ 0 1 3 2 ] Ttfc'U R cp l±rny'x^^II5;»c 
LfcEMEffW. T cp li7o-/'i ? LfcM 

STEP4 

asgocR" , iisiopp" io^iciOQ (x p , 

y P , z p ) &5£#>l>. 



[0 133] 
IW4 1 ] 

OpP* 



UP 



' up 



'up 



(5 3) 



OcR" 



X- X 



po 



[0 134] 
[0135] 
[f&4 2] 

y po 2 _ 2 po 



x pr X po 



ypr-y 



po 



2 pr 2 po 



(5 4) 



[0 136] 
[0 137] 



= x u P { x po iypr - y P a )~ ypo ( X pr ~ X PQ )} 

Xp -y (y r - y po )- y» P tar ~ x p° ) vi 
y up Ypo (ypr - y P o h y P o\ x ^ - x wi , 

y„ = ? i 1 r— Ko 



2 p = 



x «p {ypr -ypo)- y« P (■*> - x po ) 

fp Ypo Vpr - ypo ) - ypo \ X pr ~ X po )\ 
x lt p\?pr - y p o)~ y„p( X pr ~ X po) 



5) 



[0 138] orfc. &f^JW¥85liB*«ffl;MM£6 

**aj*-r * b^we^s 3 *^c7> ttj^j tew o 

fc±T\ 0MRA*#»l#^r41IH«fc»U OMR 

[0139] ztibrt&mttmmi. msw 11-23 



6 1 8 7 * t mmcoar^mz x 0 irbix £ . 

[0140] SWW, tft^BSS»#S2(di. & 
[0141] ifcfc. s^a®^©2«. ai§<? 
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(a, b, c) t^oSM^h/Utf^tb^tltim^, 
JiMlitan-i (b/a) bLXi&tbhtl. fifWti 
tan-' <c/V (a2 + b2) ) k LT3W>£>il& . 

[ 0 1 4 2 ] 8flc. gMtffg2«7nyx ? ?g 

[ 0 1 4 3 ] <Mc. B*<affljE#a3{±M^*IIEO«iaS: 
Hi Sfcit/lll 9<0-Ht-m*i, 

ro x 9 ?mm i o o co&mvmz . td >-'x ? ?g 
w<7)%mt zcoimm 109 <7>wm.*>? h)vz-&ts*m 

X®MLt:imZ^mmmX'hZ>. S^Hi 1 2«T 

Dyi^^gn oo*^aii:^i,WT\ wmi 

1 2^fit^^ixSJ;d^a«t'ISiE$^T. *£f£Sl 1 

libit, mmmi 1 2(cwe, vui;*7-?%Mb 
irnmi iob<D$unzm&¥mtfem-t&. 

[0 144] i-T. I18CfeV^, 7nitx.7?mm. 
10 0^22111 1 2&Xcr>%m£Z0. 7Dxi? 

?mwi oofrt>fowmi 1 ltx^^mzzib-t 

•Si:. £^££tt*y«lf&L<fcPtiiffiHBl 1 1 Kfc 

B*fJ&Si<*>ytt«£ZO/ZlffiK y" = y • Zl 

/Z0ht-&#g#£>l>. infimM^fc^/MtffT' 

[0 14 5] $^>tc, 01 9(3fcV^T. <R«mHl 1 1 
KfcttiylWfiLjWBWffil 1 Otfcv^T|Blt<L^ 

tan <£/t a n <9fg, o£ 0. y" = y ■ t a n<£/ 
t a n 6 = y - Zl • c o s a/ ( Z1+ y • s i n a ) 
fc-f&£Kftf&*. xiico^tii, EB§iZ3<7)fiB 

= Z1 (Zl + y •sina) h3r6. 

[0146] JiLh*>\ #»pitf>si i cDmtmmx'h a . 



coi47]orc, i ^niis^!)*{: 

ovvrSMHT*. *H*S»««i. rny'i^^ • 
[0148] ^rC. *»^20»1(:-5V^ 

lai lfciMSi/cswiH-*. #iii£»m. ssi^n 

[ o 1 4 9 1 as i n&ffi&fmmi&ftji^®. 1 w 

^ltt^wiHTOimi^^ nam 

[0150] m2cr,mmmmxn. ss?ywm£j&^®. 
Atf&&t& i ftcovimnwz&zm&ts*. oszL 
x. *ix?iwmfa\iWZixhWt^*&irtre 
Bawsfc^k-r*. zo-t&ztizx-oxim-t&Qk 

mtmm<r>m^.bLxit. H3£*-*-j:3£, mon 
iBB««n«[jft«ia{#S8 1 «ttttits#a8 1 1 b 

«WMffiiJ*S8 1 2 klta!l^{aM^tti^S8 1 3*^fg 
[01511011 Tii^vW«^#&4<5D£j£-r 

h^y^z-o^x^ v l—AcDA-ocnm^^vx^ 

h.mi lTfcfc£j£W>ffl»a*l 5fficO%^{co^T^L 

i l^wc^ix-e'^^^vT'f^-ra^^^L^. 

[0 152] 
[^1] 







*9>2 






61 


O 


O 


o 


o 


,62 




o 


o 


o 


.63 


O 




o 


o 


,64 






o 


o 


.65 


O 


o 




o 


-66 




o 




o 


67 


O 






o 


.68 








o 


/S9 


O 


o 


o 




610 




o 


o 




;<ai 1 


O 




o 




.612 






o 




613 


O 


o 






,61 4 




o 






61 b 


o 









[0 153] ZCDbZ. H£tfjS[3*ttaW-**&fc: 



[0 154] i«J:a**ifi^fc*«*. t^^- 
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1 osz (N+l ) X'foh. 

[0 15 5} 
[gt4 4] 

2 

[0 15 6] T'hh. 

[0 157] 
[&4 5] 

N + l 
\ 

[0 158] x-hh. 

[01591^7211 B*«tii^#S 1 tf*ix?ticr> 

[0160] ^-r. mtm&^&8 1 1 {i. ?m 
mizftLxi$&ztitz&cm®£tfiiii?z>. c\(7)mmij 

[0161] mmm^WLS 1 2i±. fsii&aj^&s i 
^ai$^*^fijfflLT^nsoi^ij^^d . mux. 

HI 10±3&4ow^>miH-S*§^-m. /t* 
^1,^7^3, ^?y4Zi$&lXtflliiZti. 

2 lx mm z ti^fr-o fz£.<?>mt&$:£. 3 izttm-t 

hb%z.hWX'h&. ztnt. n?vi. n 

£~>xm$x'Zh. 

[0162] s\-M£MWm&^®8 1 3 it. m^tttz 

h. 

[oi63] m±*Jftai^ai*S8 1 coumx-hz. 
[oi64] stmgg.m{mM&^&8 Atmnmft 
it. $$i<7)mmmtmtx'foz>. 
[oi65] v±#*micom2cr>mmmmx'h&. 
[oi66]orc> *micr>m2<r)mtmm<D%)mz 
^xwftth. *mm&mit. micommmnvm: 
izmtx. &ri,zft^&mi<?>%>$ki>^-?&. 
[oi67] *mtmmit. mw&z&tsvkmzm®. 
s»u Q^-Ytt.m* l z£r)-m\-?htzih. 

W&VtWiZ'Jr+t^hZbtfX'ZZ,. Ltztf^X. mi 

(rmm&mzit^xammmzm < - 1 &x-z h . 



[ o 1 6 8 ] xwjicomscomimmiz-o^x 
mmizmm-t^. *mtmmt. mi. m2^mtmm 
iztufmrn^mm^m i <Dnm.^mtammzmii 
n-t&i>cox'h*). arizmi 2£mmLxmMizmw 

[oi69] m3comtmm(Osim^Mtt,^8 1 iz* 
-oxmm^mm-t^i^. -mizmi 2(a) ^$ 
tih x oizmm&cDfrZtfiiiiX'Z zmx-ittw mm 

ft.112 ( b ) iZyjkZix&J: o IzWtm&tflktittmffi. 

mzmtixmitiX'Z*fr~>tir) . 01 2 ( C > 

t J: -oTH"S!l^cO-gSco«lS*^ttT Lit d . 
[0170] *HSS^®-C'{±. ±ie?>cfc 3 ^«i5lT-Ct 
H-a*^iE5l(^tfi-r-&^tf0#?£-CS)?.. 04*3 J;tf 

8 1 Oflf j£ $r^y C7 y ? HT'S) ZZX'. 04 JiMI 
1 o»»ftJE21^*«5£ L . 0 5 am 2 <r>m 

mm\znm^ ^tz^mi^trnx-h h . 

[0171] 04^-rtfffl^ffi#e8 1 ?)i§ 

X'foh. 

[ o 1 7 2 ] 04 ^^-rn-ate^ai*S8 1 <r>mm%m 
mmT<7)m>ox'fc&. 

[0173] Wmm^8 1 1 ii, yWm*cr>i5. 

&ztifzm®zmft^& (01 3^*^2#a<7)0) . 

t h-Hm^nmLtzm^z^xm^Liz. 
[0174] mm^m.mm : i'&*®.8 i5ii «mrhj* 
^&6x-wmzimLxi>i£&fficr>ttb'<omwx'*j< 
?mmizi^x*coytmzmiiiX'Z%^mi (mm^m 

[0175] ffi*£¥iJ5g^K8 1 4<i, M^^g8 1 

i o^m-r?»^*^aj^ig^fBii*S8 1 5ic 
imzKx^&mft^ittfmizfrfr-ix&t,?. n-aa* 

Sr L fz ffi.®£fc ^mtHLX^^^b'oii^ ¥H^"f 

d^t&^f-s. *-f, y^visytcbzm^xffimi 

1 ) . 

[0176] m®t*2^wj3m-t&%%. $>&m±& 
GLZ^mnrizit. wmtiij}^&iizwfew®.z®mz 

m®tflr>l,frKc^t9r&l3.. *<7)ffi®lzttLxm 
®WZk%m&tiH J t& (01 3tCt3(t-S.0MX*^3Sg 

^0) (xf?rA2) „ zcvm®iick*mizm%-£ 1 
wmwmz itz>mmco>mx'+ttX'h h . 
[0177] ^'iz. mmkkz Ltzmmbmm^^. 
mm%-&8 1 5izm&2tix^z, 2mmwib<m.^b 
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B&gLT^^%£(4. XxyTA3(cT«£i:o*:W& 
(01 3<CJ3»t*BnB*i±«H) . 

»«■ t ^izwmz$u&tt (Hi 3 

C*5(-rS0»&Ttf>0) . -e^T\ »itofcI«c« 
4) . Mt#ftLT^*^tf*(^)1B«tc«LTH-«jS 

[0178] itiH£ffiHftffl#R8 1 3 (4. «S?PJ5g# 
88 1 41ZX OtMfta*«»LfeflWBM*c**aiLrv^ 

[0179] o¥(C, H5t=*tfti!ljft*aJ¥S8 1 CO 

^§6, #^97(4. »2<onaeB«k^<ratT* 
s. 

[0180] n«&ffi3M38 1 <*>sM*iwmErRo 

[0181] «J|g«lttJ#S8 1 1 (4. #X?P< 

«tc»LTS»$nfcjs<?5fa«*ttaj-rs (bisks 
(ts£±*^25Boia) . 

t&t cox* ^mmcomft* fc humzmm vtzm-siz 
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